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Abstract 


An online survey was conducted of students, instructors, and researchers in dis- 
tance education regarding principles for the ethical treatment of human research 
subjects. The study used an online questionnaire based on principles drawn from 
Canada's Tri-Council Policy Statement, Ethical Conduct for Research Involving Humans 
(TCPS, 2003), which the authors had sometimes found problematic in their own 
distance education practice (as researchers, in their work with graduate students, 
and as Research Ethics Board [REB] members). Overall, findings showed that 
respondents tended to agree with the principles presented, whether consistent or 
not with the TCPS; however, those with more research experience showed a 
tendency to agree more with questionnaire items that were consistent with the 
TCPS, and less with those items not consistent with the Policy, a pattern that was 
more pronounced in a group of 25 published researchers invited to participate. 
Conclusions were that research experience was associated with greater agreement 
with the TCPS's principles, with ethics issues, and with REB experience; that by 
their own admission many participants were not well acquainted with the TCPS; 
and that efforts to address the reservations of distance education researchers about 
ethics review should include the involvement of experienced researchers, as this 
group probably best represents the ethical norms and practices of the field. 

Resume 


Des etudiants, des professeurs et des chercheurs en education a distance ont 
participe a une etude en ligne portant sur les principes d'un traitement ethique des 
etres humains en tant que sujets d'experiences en recherche. Le questionnaire en 
ligne utilise etait base sur des principes issus de YEnonce canadien de politique des 
trois Conseils, section Ethique de la recherche avec des etres humains (EPTC, 2003). Les 
auteurs ont parfois trouve cet enonce problematique dans leur pratique en forma- 
tion a distance (en tant que chercheurs, dans leurs travaux avec des etudiants 
gradues et en tant que membres du Comite d'ethique de la recherche (CER)). En 
general, les resultats ont montre que les repondants avaient tendance a etre d'ac- 
cord avec les principes presentes, que ces principes soient coherents ou non avec 
l'EPTC. Cependant, les repondants ayant plus d'experience en recherche avaient 
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tendance a etre plus en accord avec les articles du questionnaire qui allaient dans 
le meme sens que 1'EPTC, et a etre moins en accord avec les articles qui n'etaient 
pas compatibles avec l'enonce de politique. Cette tendance s'est montree plus 
marquee chez un groupe de 25 chercheurs reconnus invites a participer. De cette 
etude, on a conclu que : l'experience en recherche est associee a un plus grand 
accord avec les principes de 1'EPTC, avec les problematiques d'ethique et avec 
l'experience en CER; plusieurs participants inscrits n'etaient pas tres familiers avec 
1'EPTC; les demarches entreprises pour etudier la question des reserves qu'ont les 
chercheurs en education a distance vis-a-vis les revisions ethiques devraient in- 
clure la participation de chercheurs experiments, puisque ce groupe represente 
probablement le mieux les normes et les pratiques ethiques du domaine. 


Background 

In Canada the federally legislated ethical obligations of researchers, and 
the process by which research must be reviewed and approved, are con- 
tained in the Tri-Council Policy Statement: Ethical Conduct for Research In- 
volving Humans (TCPS, Medical Research Council of Canada, MRRC, 
2003), developed and jointly issued by the Medical Research Council of 
Canada, the Natural Sciences and Engineering Research Council of 
Canada, and the Social Sciences and Humanities Research Council of 
Canada. In order to receive federal funds, the TCPS's principles must be 
applied to all research conducted in the institution, whether federally 
funded or not. 

Canada's adoption of the TCPS is part of a global pattern of increased 
concern on the part of researchers for the ethical treatment of human 
research subjects. In 2003 an Internet search of the term research ethics 
resulted in over a million hits, with topics including research in teaching, 
philosophical principles, workshops on ethical principles, and ethics in 
social and political contexts. A similar search of journals revealed no fewer 
than 20 concerned with ethics, including applications in the law, the 
criminal justice system, nursing, bioethics, business, the environment, 
religion, and feminism. 

Although widespread and positively intended, increased attention to 
ethics in research has resulted in disputes over the principles (and some- 
times the process) by which proposals are judged, especially in the 
humanities and social sciences. Some disagreements have been marked, 
revealing researchers' frustration over projects delayed, altered, and even 
cancelled (Rourke, Anderson, Garrison, & Archer, 2001). 

Researchers have made their reservations plain. Beck and Kaufman 
(1994) some time ago identified various pitfalls research was beginning to 
encounter in academic settings, delaying publication and even preventing 
the conduct of some controversial enquiries in the physical sciences. (The 
debate over stem cell research is a present example.) Evans and Jacupec 
(1996) described conflicts of values between review committees and re- 
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searcher, noting a trend by ultraconservative (often religious or ideology- 
driven) groups to "challenge or terminate research they find offensive" (p. 
73). As problems grew, Vujakovic and Bullard (2001) suggested greater 
attention to anonymity and confidentiality, to help researchers navigate 
what they called the "ethics minefield" (p. 279). Some deplored the ad- 
judication process: Rourke et al. (2001) termed an experience with their 
institutional Research Ethics Board (REB), in which the objections of a 
single CMC participant resulted in rejection of an externally-funded 
project, as "tedious," and not "useful or necessary." 

Associations have also been frank in expressing their concerns. The 
Humanities and Social Sciences Federation of Canada (HSSFC) voiced the 
fear that "For some [researchers], the expansion of the purview of the 
REBs and the TCPS to scholars in the Humanities and Fine Arts will be 
viewed as a hindrance to research and as an imposition of alien regulatory 
practices upon these disciplines" (Owen, Robert, Burgess, Golfman, & 
Sykes, 2001, p. 4). These writers call for efforts "to overcome an underlying 
current of distrust that exists within the community vis-a-vis the TCPS" (p. 
4). The uneasy relations between researchers and ethics review bodies 
have become newsworthy enough to appear in the popular press: Begley's 
(2002) article in the Wall Street Journal, sympathetic to researchers (it was 
entitled "Review Boards Pose Threat to Social Scientists' Work"), de- 
scribed a growing rift between researchers and ethicists; other articles 
have questioned standards and accountability in clinical drug trials, espe- 
cially those involving paid ethics reviews (Munro, 2004; Dohy, 2004). 

The problem of judging proposals is made more difficult by the fact 
that REBs receive little practical guidance from the TCPS. For example, 
although the Policy briefly refers to research conducted by under- 
graduates, the needs of a far larger group of student-researchers, graduate 
students, are ignored completely, as are the well-established roles and 
responsibilities of advisors, supervisors, and academic committees. We 
believe these needs are real, having ourselves experienced complications 
due to REB involvement in graduate student research. We can attest that, 
unless coordinated with other advice, an REB's interventions can appear 
merely intrusive. (One of our students commented after his review, "[The 
REB] takes its work very seriously. However, I'm not sure it knows 
enough about [the proposed method]. Probably more than me — but not 
enough.") 

The TCPS enjoins REBs to apply ethical principles "in the context of the 
nature of the research and of the ethical norms and practices of the 
relevant research discipline" (TCPS, p. i.9). This position is consistent with 
the etymology of ethics, from ethos, character, custom, or usage (Hinman, 
2000), suggesting the importance of context in ethics. Determining a 
discipline's customary norms and characteristic practices requires REBs to 
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"Linderstand the human research ethics issues arising from diverse 
methodologies" (Owen et al., 2001, p. 9). To our knowledge, no reports 
have appeared that describe the "ethical norms and practices" in distance 
education research involving human subjects. To assure sensitive com- 
pliance with the spirit as well as the letter of the regulations, researchers 
must know the principles contained in the TCPS; again, no studies of 
distance education researchers' knowledge of or views on the contents of 
the TCPS have, to our knowledge, been published. 

This study was intended to address the lack of knowledge in these 
areas by assessing awareness and acceptance of some fundamental, yet 
potentially problematic, ethical principles contained in the TCPS, and to 
evaluate the effect of research experience on ethics by comparing the 
views of individuals with varying research backgrounds. The key variable 
in the inquiry was the participants' self-assessed research experience. This 
term was not defined in the study, and is a weakness in the design to the 
degree that respondents may have interpreted the term differently from 
our meaning, or from one another. As shown in the Appendix, par- 
ticipants were told that the study involved the views of "distance educa- 
tion researchers and practitioners" about ethical positions, requiring them 
to provide information about their "research background." The actual 
questionnaire item read, "Describe your research experience (1 = none; 7 = 
extensive)." Although confusion may have arisen for some respondents 
over whether the item referred to their experience as a researcher or as a 
subject, we feel that any such uncertainty would not affect assessments of 
the research principles under study — unless respondents applied a 
separate standard to themselves as researchers, as opposed to the stan- 
dards they expected to protect them when they were the subjects. Al- 
though there is no evidence this was a common interpretation, the point is 
noted here, with the suggestion that future research might explicitly ad- 
dress the possibility of multiple and potentially conflicting standards and 
definitions in relation to ethics principles. 

Background: Ethics in Human Subjects Research 

The TCPS makes plain that ethical standards in human subjects research 
are not absolute, but must respond to varying contexts, circumstances, and 
disciplines. There is a tension, which ethics reviews attempt to address, 
between the right to do research (within the norms and practices — the 
research ethos — of the discipline) and the responsibility to protect sub- 
jects, especially those unable to protect themselves. The TCPS adopts an 
exceptionist stance (MacFarlane, 2002), a relatively moderate position in 
which ethical principles are applied pragmatically and flexibly in response 
to circumstances (researchers are expected to present to the REB the spe- 
cial circumstances that they believe justify exceptions). 
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As distance education practitioners (faculty members who teach and 
supervise graduate students) and as researchers, we interact regularly 
with our institutional REB and with other REBs under which our students 
and colleagues (sometimes as co-researchers) work. These experiences 
(and that of serving on our institutional REB) have led us to observe that 
certain principles of the TCPS tend to be contentious in the ethical review 
process. The following is a summary of the more contentious principles of 
the Policy, based on our experience. 

Respect for human dignity. This cardinal principle requires that persons 
not be used solely as means to ends and that "the multiple and interdepen- 
dent interests of the person" be protected by the REB (TCPS, p. i.5). 
Historically, interest in this principle arose from the emergence early in the 
20th century of systematic programs of medical research (Evans & 
Jakupec, 1996). Presently, most ethics statements hold that, with a few 
exceptions, the rights of subjects should take precedence over the advance- 
ment of knowledge (TCPS). Under this principle, special protection is 
accorded to heteronomous groups or persons (those not fully capable of 
exercising free choice or of independently protecting their own interests), 
especially those in cultural or power-authority situations who might be 
the victims of even inadvertent coercion (e.g., patients, inmates, institu- 
tionalized people of all kinds, students, clients, etc.). 

Respect for human dignity is demonstrated in research by the practice 
of requiring researchers to obtain and maintain the free and informed 
consent of subjects throughout the research. Not everyone is protected by 
this principle, however, as closer examination of the free and informed 
consent principle reveals. 

Free and informed consent. This principle is often spoken of as the 
cornerstone of ethics in research (McNamee, 2001; Vujakovic & Bullard, 
2001; O'Connor, 2002). The TCPS itself calls informed consent "the heart of 
ethical research involving humans" (p. 2.1). Interestingly, for a concept of 
such primacy, the TCPS recognizes a wide variety of situations in which 
informed consent can either be waived completely, obtained post hoc, or 
otherwise complied with less than fully. 

The TCPS allows REBs to waive the requirement for fully informed 
consent if the following conditions are met: 

1 . The research is minimal risk. 

2. The waiver is unlikely to adversely affect the rights and welfare of the 
subjects. 

3. The research could not practicably be carried out without it. 

4. Subjects will be provided with additional information after participa- 
tion, "whenever possible and appropriate." 
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5. A therapeuitic intervention is not involved (normally precluded by 
point 1). 

When it is not possible to obtain full informed consent, the TCPS 
recommends that subjects be debriefed after the fact if "feasible." It also 
suggests that subjects who object after debriefing be given the opportunity 
to remove themselves and their data from the study; however, the REB 
may grant an exemption to this principle to preserve the integrity of the 
research, by avoiding "colour[ing] the responses of the subjects and thus 
invalidating] the research" (TCPS, pp. 2.2-23). Also, the rights of the 
majority to participate in research are protected over the objections of 
those who may not wish to do so (this is the principle under which the 
problem encountered by Rourke et al., 2002, mentioned above, might have 
been addressed). 

In cases where a subject expresses concerns about a study, the researcher 
may give the subject the option of removing his or her data from the project. 
This approach should be used only when the elimination of the subject's data will 
not compromise the validity of the research design, and hence diminish the ethical 
value of participation by other subjects. (TCPS, p. 2.3; emphasis added) 

Other entities and individuals who enjoy less or no protection under 
the informed consent provisions of the TCPS include: 

1 . Public bodies and corporations, including governments, political parties, 
authoritarian organizations, and criminal groups. 

2. Private organizations. These have the right to decline to participate or 
to deny access to their private records and may attempt to set limits 
on the participation of their employees, but may not interfere with or 
veto research about their own conduct, their participation in any re- 
search about their behavior is not required, and they need not be ap- 
proached for their consent prior to research being conducted. 

3. Public figures. "Certain types of research . . . may legitimately have a 
negative effect on public figures" (p. 1.6), including all public per- 
sons, artists, and performers (and their works), politicians, and busi- 
ness leaders. 

4. Subjects of naturalistic observation techniques. With the protection of 
anonymity, the TCPS permits waiver of informed consent. 

5. Students in classroom and course evaluations. " Nothing in this Section 
[Article 2.4] should be interpreted as meaning that normal classroom 
assessments of course work require REB approval" (p. 2.6; emphasis 
in original). 

6. Those involved in quality assurance and performance reviews. "Quality as- 
surance studies, performance reviews or testing within normal educa- 
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tional requirements should also not be subject to REB approval" (p. 

1 . 1 ). 

Privacy and confidentiality. If there truly is a key ethical concept in 
human subjects research, this may be it. The TCPS notes that "in many 
cultures, privacy and confidentiality are considered fundamental to 
human dignity" (p. i.5), and that "privacy is a fundamental value, per- 
ceived by many as essential for the protection and promotion of human 
dignity" (p. 3.1). 

Nevertheless, as with the principle of informed consent, the right of 
privacy is not absolute. The TCPS acknowledges that issues related to the 
public good (e.g., control of contagious diseases, and increasingly, certain 
security and crime prevention practices) may permit suspension of protec- 
tion of some kinds of personal information. Use of information already 
part of the public domain, even involving identifiable nonpublic persons, 
is permitted, as is subpoenaed information. Naturalistic observation, 
when anonymous, may also fall under this exemption. 

Justice and inclusiveness. This principle assures that no group in society 
unfairly bears the burdens or enjoys the fruits of research. Respect for 
justice and inclusiveness holds that as long as the methodology is sound, 
all contributions are anonymous, and identities are protected in any 
reports, it may well be a greater ethical violation to deny the rights of the 
willing majority than it would be to accede to the wishes of the reluctant 
minority by refusing to approve research. The TCPS asserts, " Nothing in 
this Policy should be interpreted to mean that research subjects have the 
right to veto a project, though they do, of course, have the right to refuse to 
cooperate with the researcher(s)" (p. 1.2). The concept of secondary use of 
data (TCPS) under which, with anonymity as protection, access to certain 
already-existing data may be gained may also promote inclusiveness by 
enabling some research to be conducted even over the objections of a 
minority of subjects. This argument might have assisted Rourke et al. 
(2001) to pursue the research that was ultimately prevented by the objec- 
tions of a single subject, noted above. 

Balancing harms and benefits. This is the purpose of ethical review of 
research. Some researchers (O'Connor, 2002) argue that all research is 
unethical to some degree, and no research is completely harmless; the real 
question is: "Ethically sound from whose point of view?" (Pendlebury & 
Enslin, 2001, p. 361). 

According to this principle, a balanced assessment of the potential 
harms and possible benefits of research requires seeing the research from 
multiple perspectives, without privileging any particular disciplinary or 
moral perspective (TCPS; Small, 2001). A consequence of this reasoning, as 
noted above, is that some ethical approaches and forms of research (biog- 
raphy, artistic criticism, public policy research, and investigative jour- 
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nalism, inchiding whistle-blowing), althouigh having clearly negative ef- 
fects on identifiable persons, institutions, or organizations, maybe ethical- 
ly permissible because the balance of social benefit and individual harm 
favors the former despite the obvious presence of the latter. 

Key points in relation to the assessment of harms and benefits are: (a) 
the TCPS does not require that research be free of all risk, only of unneces- 
sary risks; (b) all the risks potentially present in the research do not have to 
be known or ameliorated before research can be started: indeed, identify- 
ing and quantifying risks to humans is often a key purpose of research; (c) 
obvious and suspected risks may be justified if potential benefits outweigh 
them; and (d) the researcher's duty is to ensure that participants under- 
stand and accept any risks of harm initially, and continue to do so 
throughout the research. 


The Study 

Based on the extent of their self-reported research experience (including 
none), we assessed the views of practitioners, faculty, and students 
(n=147) involved in distance education about selected ethical principles 
from the TCPS that, in our experience, have proven problematic. Par- 
ticipants volunteered in response to invitations posted on the Web sites of 
three Canadian distance education organizations: the Alberta Distance 
Education and Training Association (ADETA), the Canadian Association 
for Distance Education (CADE), and Athabasca University's Centre for 
Distance Education. A further group of published researchers (n = 25 of 83 
invited; 30%), whose work had appeared within the past six years in the 
CADE Journal of Distance Education ( JDE ), participated in response to a 
personal invitation to do so. In the analysis, the views of respondents (total 
fl=172) were examined on the basis of two criteria: self-described research 
experience (from none to high), and a record of recent research publication. 
The research questions were: 

1 . To what degree does self-assessed research experience (including 
none) affect agreement with selected ethical principles (consistent 
and not consistent with those contained in the TCPS)? 

2. To what degree do the views of researchers with a known record of 
publication (the invited group) differ from those of other respon- 
dents? 

The survey instrument was a questionnaire consisting of 31 statements 
about ethics in research (Appendix) reflecting principles that in our expe- 
rience as advisors, researchers, and REB members, have produced 
problems of interpretation. Eighteen of the statements used in the ques- 
tionnaire were consistent with principles found in the TCPS, whereas 13 
were not. Items were rated using a 7-point Likert-type scale (Appendix). 
The instrument was developed by the researchers and piloted with col- 
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leagues and graduate students in the Centre for Distance Education, 
Athabasca University. (As a result of piloting, the number of items was 
reduced from 34 to 31, and wording changes were made to some items, 
(the Appendix contains the instrument.) 

Items that were not consistent either contradicted the TCPS or made 
assertions not found in the Policy. The ethical content or legitimacy of 
these not-consistent items was not in question. In fact, the basic approach 
of the TCPS ("As a condition of funding, we require, as a minimum, that 
researchers and their institutions apply the ethical principles and the 
articles of this policy"; p. i.2, emphasis added) grants that individuals or 
institutions may adopt more stringent ethics standards. The question was 
the degree to which the standards of the TCPS were in fact viewed by 
respondents of differing research backgrounds as minimal, optimal, or 
applicable at all. 

Some limitations in the study's design potentially affecting interpreta- 
tion of the results include, as noted above, the possibility that respondents 
may have interpreted differently the undefined term research experience. 
They may also have applied the 7-point scale differently (the instrument 
did not offer interpretations for values other than 1 none and 7 very exten- 
sive). Also, those who claimed research experience were not asked to 
describe the nature of that experience (whether the experience was as 
researcher or subject). The reader should consider these facts of the study's 
design in relation to the results, and future researchers are advised to 
control for them in any further study of these questions. 


Table 1 

Sources of Access to the Survey, by Self-Described Levels of Research 
Experience 


Source of 
access 
to the survey 

No 

research 
experience 
# % 

Low 

research 
experience 
# % 

Moderate 
research 
experience 
# % 

High 
research 
experience 
# % 

Total 

# % 

Athabasca 











University 

11 

12.8% 

40 

46.5 

27 

31.4 

1 

9.3 

85 

50.0 

CADE 

1 

4.8 

7 

33.3 

11 

52.4 

2 

9.5 

21 

12.2 

AD ETA 

1 

12.5 

2 

25.0 

4 

50.0 

1 

12.5 

8 

4.7 

Other 

7 

21.9 

12 

37.5 

13 

40.6 

0 

0 

32 

18.6 

Invited 











researchers 

0 

0 

0 

0 

11 

44.0 

14 

56.0 

25 

14.5 

Total 

20 

11.6 

61 

35.5 

66 

38.4 

25 

14.5 

172 

100 
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Table 2 

Personal and Professional Differences, All Respondents, by Self-Reported 
Levels of Research Experience 


Variable No research 

Low 

Moderate 

High 

Total 

experience 

research 

research 

research 

(n=172) 

(n=20) 

experience 

experience 

experience 



(n = 61) 

(n = 66) 

(n = 25) 


# % 

# % 

# % 

# % 

# % 


Sex 


Male 

8 

14.5 

12 

21.8 

20 

36.4 

15 

27.3 

55 

32.0 

Female 

12 

10.3 

49 

41.9 

46 

39.3 

10 

8.5 

117 

68.0 

Total 

20 

11.6 

61 

35.5 

66 

38.4 

25 

14.5 

172 


Degree 

Diploma 

1 

25.0 

0 

0 

3 

75.0 

0 

0 

4 

2.3 

Bachelor’s 

18 

15.3 

53 

44.9 

41 

34.7 

6 

5.1 

118 

68.6 

Master’s 

1 

5.3 

6 

31.6 

9 

47.4 

3 

15.8 

19 

11.0 

Doctorate 

0 

0 

2 

6.7 

13 

41.9 

16 

51.6 

31 

18.0 

Total 

20 

11.6 

61 

35.5 

66 

38.4 

25 

14.5 

172 


Ethics experience 
None 17 

41.5 

18 

13.9 

5 

12.2 

1 

2.4 

41 

23.8 

Low 

3 

3.5 

41 

47.7 

35 

40.7 

7 

8.1 

86 

50.0 

Moderate 

0 

0 

2 

5.1 

25 

64.1 

12 

30.8 

39 

22.7 

High 

0 

0 

0 

0 

1 

16.7 

5 

83.3 

6 

3.5 

Total 

20 

11.6 

61 

35.5 

66 

38.4 

25 

14.5 

172 


REB experience? 
Yes 0 

0 

4 

21.1 

3 

15.8 

12 

63.2 

19 

11.1 

No 

20 

13.2 

57 

37.5 

62 

40.8 

13 

8.6 

152 

88.9 

Total 

20 

11.7 

61 

35.7 

65 

38.0 

25 

14.6 

172 


Familiarity with TOPS 
None 16 19.8 

27 

33.3 

29 

35.8 

9 

11.1 

81 

47.9 

Low 

3 

5.2 

28 

48.3 

23 

39.7 

4 

6.9 

58 

34.3 

Moderate 

0 

0 

6 

28.6 

7 

33.3 

8 

38.1 

21 

12.4 

High 

0 

0 

0 

0 

5 

55.6 

4 

44.4 

9 

5.3 

Total 

19 

11.2 

61 

36.1 

64 

37.9 

25 

14.8 

169 


Invited researcher? 
Yes 0 

0 

0 

0 

11 

44.0 

14 

56.0 

25 

14.5 

No 

20 

13.6 

61 

41.5 

55 

37.4 

11 

7.5 

147 

85.5 

Total 

20 

11.6 

61 

35.5 

66 

38.4 

25 

14.5 

172 



Results 


The Respondents 

A total of 172 Lisable suirveys were returned. Respondents identified the 
source from which they accessed the questionnaire, as shown in Table 1. 
(As noted above, research level was obtained from self-described research 
experience based on the 7-point scale from 1 none to 7 very extensive ; thus 
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as shown in Table 1 and thereafter, 1 = no research experience, 2-3 = low 
experience, 4-5 = moderate experience, and 6-7 = high experience.) 

Response rates for the data contained in Table 1 can only be estimated. 
The Athabasca University respondents were graduate students in a dis- 
tance education master's program, which at the time of the study had an 
overall enrollment of approximately 350 program students. Using this as 
the denominator, the response rate for the Athabasca University student 
group was about 25%. Twenty-five of the 83 published researchers who 
were personally invited to participate did so (30%). The invited re- 
searchers were the group most likely to rate their research experience 
moderate or high, and the only group to have no members who rated their 
experience none or low. (Not all the invited researchers, all of whom had 
published in JDE in the previous six years, rated their experience high, 
whereas some who rated their own research experience as high may not 
have published: this information was not requested.) 

Table 2 shows how self-reported research experience was associated 
with other personal and professional characteristics of the respondents. 


Analysis by Levels of Self-Reported Research Experience 

In the following discussion the 7-point scale used by the respondents to 
rate the questionnaire items was interpreted as shown below. (Note that 
only the polar values 1 = Disagree completely and 7 = Agree completely were 
provided in the instrument.) 


Scale rating 
Below 1.5 

1. 5- 3.5 

3.5- 4.5 
45-6.5 
Above 6.5 


Interpretation 
Disagree completely 
Tend to disagree 
Neutral 
Tend to agree 
Agree completely 


Table 3 

Mean Ratings of Questionnaire Items Consistent and Not Consistent With the 
TCPS, by Self-Reported Levels of Research Experience 


Items’ No research 

Low 

Moderate 

High 

Total 

consistency experience 

research 

research 

research 

(n=172) 

with the TCPS (n=20) 

experience 

experience 

experience 



(n=61) 

(n=66) 

(n=25) 


Mean SD 

Mean SD 

Mean SD 

Mean SD 

Mean SD 


Consistent 4.80 .508 4.74 .595 4.96 .627 4.97 .560 4.86 .598 

Not 

consistent 5.40 .838 5.04 .886 5.07 .768 4.65 1.11 5.04 .878 
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Table 4 

Significant Differences in Agreement, by Levels of Research Experience 


Item 

Relation 


Highest 



Lowest 


f 


to TCPS 

agreement 



agreement 

(sig-) 

Boldface item 
consistent with TOPS 


Grp 

Mean 

SD 

Grp 

Mean 

SD 


9. In ethical research, 

Not 

None 

5.15 

1.73 

High 

3.84 

2.32 

.042 

human subjects are 

consistent Low 

4.98 

1.76 




.015 

never.subjected to risks 
of harm 









12. The ethical review 

Not 

None 

5.80 

1.47 

High 

4.46 

2.00 

.017 

process has as one of its 
aims the purpose of 
blocking research which 
does not include 

consistent 








collaboration with the 
research subjects. 

20. Written consent to 

Not 

None 

5.45 

1.76 

High 

4.16 

2.32 

.046 

participate must be 

consistent Low 

5.26 

1.48 




.010 

obtained, for research to 
be fully ethical. 

21. Corporations must 

Not 

None 

4.84 

2.17 

High 

3.40 

2.06 

.032 

approve of the 

consistent Low 

4.97 

1.84 




.002 

participation of their 
employees in research 
conducted by outsiders 
involving the corporation. 
22. Subjects must always 

Not 

None 

5.95 

1.54 

High 

4.40 

1.92 

.004 

be given full information 

consistent Low 

5.33 

1.64 




.040 

about the research, as 
part of the provision for 
obtaining informed 
consent. 

25. Research must not be 

Not 

None 

4.89 

1.85 

High 

3.64 

2.06 

.040 

conducted in 

consistent Low 

4.69 

1.61 




.013 

circumstances where 
subjects do not know they 
are being observed, or 
otherwise cannot give their 
free and informed consent. 









28. Anonymity is the 

Consistent High 

6.13 

1.04 

Low 

5.46 

1.44 

.021 


best protection of the 
confidentiality of 
personal information 
and records. 
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Table 5 

Use of Categorical Terms in Questionnaire Items (from Table 4) 


Item # 

Categorical term(s) 

9 

Never 

20 

Must 

21 

Must 

22 

Must, always 

25 

Must 


A general observation about the four levels of research experience 
(none, low, moderate, and high) was that the responses of all groups were 
skewed toward agreement on the 7-point scale. The totals in Table 3 show 
this pattern; all levels of research experience were within the tend to agree 
range for all items, whether consistent or not consistent with the TCPS. 

There were differences on specific items, as shown in Table 4 (the 
Appendix contains the actual wording found in the TCPS for those items 
not consistent with the Policy; items consistent with the TCPS are in 
boldface type in the Appendix). 

As shown above, the mean ratings of the high-experience group dif- 
fered significantly from the none / no- and the low-experience group on six 
items. In all cases the high-experience group showed less agreement with 
those items not consistent with the TCPS, and more agreement with the 
consistent item (28), than did the less experienced. (The f-test is a common- 
ly used statistic in survey research employing Likert-type scales [Santos & 
Clegg, 1999]. It is also less sensitive to departures from normality such as 
those observed here including varying sample sizes and differences in 
variances [Norusis, 1984].) 

Five of the six not-consistent items in Table 4 contained the emphatic 
and categorical terms must, never, and always, as shown in Table 5. Because 
of the inflexibility inherent in these terms (and typically not found in the 
TCPS), agreement implies less willingness to consider context in making 
judgments and greater willingness to impose restrictions on researchers. 

Based on the above data, it appeared that self-reported research experi- 
ence affected agreement with the principles presented: although the in- 
stances where significant differences were detected were relatively few (7 
of 31 items; 23%), those respondents with more research experience were 
consistently more likely to express greater agreement with ethics prin- 
ciples consistent with the TCPS than those with less experience; those with 
less research experience expressed more agreement with items not consis- 
tent with the TCPS and more agreement with items not consistent with the 
Policy containing unconditional language. 





PRINCIPLES FROM CANADA’S TRI-COUNCIL POLICY STATEMENT 


41 


Table 6 

Invited Researchers Compared With Others, Items Consistent With the TCPS 


Item 


Others 


Invited 

t 



(n=127) 


researchers 

(sig-) 





(n=25) 



Grp 

Mean 

SD 

Mean 

SD 


2. Ethics review should incorporate 

Mod. 

5.44 

1.24 

6.04 

1.02 

.028 

a reasonable flexibility in 
implementing common principles 
(p. i.2). 

High 

5.09 

1.22 



.038 

6. Treating subjects as a means 
(mere objects or things) fails to 
respect their intrinsic human 
dignity and thus impoverishes all 
humanity (p. i.5). 

High 

6.09 

1.04 

4.36 

2.12 

.015 

13. In assessing a research 

Low 

5.52 

1.15 

6.24 

1.23 

.017 

proposal, the ethical review process 
should consider the nature of the 
research and the ethical norms and 
practices of the relevant research 
discipline (p. i.9). 

Mod. 

5.51 

1.20 



.018 

16. Research subjects do not have 

Low 

3.38 

1.69 

4.57 

2.29 

.011 

the right to veto a project (p. 1.2). 

Mod. 

3.42 

1.60 



.015 


High 

2.64 

1.57 



.008 

18. The principle of proportionate 

Low 

4.04 

1.17 

5.32 

1.80 

.001 

review permits research which 
exposes human subjects to minimal 
risk or less to receive only minimal 
review (p. 1.11). 

Mod. 

4.37 

1.42 



.050 

19. Under some circumstances, the 

Low 

3.41 

1.91 

4.84 

2.27 

.008 

requirement for informed consent 

Mod. 

3.50 

1.91 



.014 

may be waived (p. 2.1). 

High 

3.09 

2.02 



.031 


Views of Invited Researchers 

The second sturdy question concerned the degree to which the views of the 
invited researchers (n= 25) agreed with those of the rest of the respondents 
who reported at least some research experience. In addressing this ques- 
tion, those who indicated they had no research experience (n= 21) were 
removed from the analysis, making this an examination of researchers' 
views only (though, as noted above, without information about the actual 
nature of that experience). 

Tables 6 and 7 show statistically significant differences for items consis- 
tent and not consistent respectively with the Policy. 





42 


PATRICK J. FAHY and BOB SPENCER 


Table 7 

Invited Researchers Compared With Others, Items Not Consistent With the TCPS 


Item 


Others 


Invited 

T 



(n=127) 


researchers 

(sig-) 





(n=25) 



Grp 

Mean 

SD 

Mean 

SD 


1 . Canada's Tri-Council Policy 

Mod. 

4.54 

1.24 

3.52 

1.69 

.006 

Statement (TCPS) may be regarded 
by researchers as a source of 
definitive answers to contentious 
ethical questions they may face in their 
research. 

High 

5.11 

0.93 



.014 

9. In ethical research, human subjects 

Low 

4.98 

1.76 

3.76 

2.40 

.010 

are never subjected to risks of harm. 

Mod. 

4.80 

1.73 



.031 

12. The ethical review process has as 

Low 

4.77 

1.66 

3.43 

2.14 

.004 

one of its aims the purpose of blocking 

Mod. 

5.23 

1.58 



.000 

research which does not include 

High 

5.36 

1.36 



.011 

collaboration with the research 
subjects. 

20. Written consent to participate must 

Low 

5.26 

1.48 

3.88 

2.47 

.002 

be obtained, for research to be fully 

Mod. 

4.85 

1.72 



.046 

ethical. 

High 

5.64 

1.36 



.035 

21 . Corporations must approve of the 

Low 

4.97 

1.84 

3.40 

2.18 

.003 

participation of their employees in 
research conducted by outsiders 
involving the corporation. 

Mod. 

4.81 

1.68 



.002 

25. Research must not be conducted 

Low 

4.69 

1.61 

3.40 

2.00 

.002 

in circumstances where subjects do 
not know they are being observed, or 
otherwise cannot give their free and 
informed consent. 

Mod. 

4.72 

1.77 



.007 


Tables 6 and 7 extend the pattern seen in Table 4: invited researchers 
differed from the others on 12 of 31 items (39%); on these 12 items of 
difference, the invited group tended to agree more with items consistent 
with the TCPS and less with those inconsistent with the Policy; further, the 
disagreement tended to be greater among those who had less research 
experience (the invited researchers disagreed 9 times with the low-experi- 
ence group, 11 times with those with moderate experience, and 7 times 
with those who rated their research experience high). This pattern, as a 
function of research experience and in relation to total mean and median 
agreement levels for all consistent and not consistent items, is shown in 
Table 8 (higher scores indicate higher agreement). 
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Table 8 

Invited Researchers’ Views Compared With Others’, Overall Agreement With 
Consistent and Not Consistent Survey Items 


Consistency with the TCPS 

Mean 

Others 

(n=127) 

SD Median 

Mean 

Invited 

researchers 

(n=25) 

SD 

Median 

t 

(sig.) 

Consistent (18 items) 

4.81 

.575 

4.83 

5.34 

.694 

5.50 

.019 

Not consistent (13 items) 

5.10 

.815 

5.23 

4.32 

.988 

4.23 

.006 


Comments From the Free-Response Portion of the Questionnaire 
The questionnaire invited all respondents to provide "additional com- 
ments." Thirty-three of 172 respondents (19%) commented, consisting of 
10 of the 25 invited researchers (40%) and 23 of the 147 others (16%). 
Comments appeared to fall into five broad categories. 

• Greater awareness: participation increased the participant's awareness 
of the issue of ethics in human subjects research. 

• Interpretation: comments on problems interpreting the questionnaire. 

• Lack of background: the participant felt poorly prepared to address the 
questionnaire due to lack of ethics or research background. 

• Elaboration: provided further elaboration on a questionnaire response; 
suggestions about the questionnaire; critique of the instrument or 
methodology. 

• Anecdotes: personal examples or experiences related to ethics review. 
Table 9 summarizes the categories of the responses for both groups. 
The greater awareness and lack of background comments are relevant to 

the first study question (degree of familiarity with the TCPS). As shown in 
Table 9, no comments of these two types were made by the invited re- 
searchers, although from several remarks it was evident that ethics issues 
were often not familiar to the other group. Examples of these two types 
include: 


Table 9 

Categories and Numbers of Free-Response Comments 


Group 

Greater Interpretation 
awareness 

Lack of 
background 

Elaboration 

Ethics 

anecdotes 

Total 

Invited (n=25) 

0 

2 

0 

9 

2 

13 

Other (n=1 47) 

3 

3 

8 

10 

1 

25 

Total (n=172) 

3 

5 

8 

19 

3 

38 
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• Interesting questions: You've sparked my interest in this topic 
(Awareness). 

• After completing this questionnaire I realize I know even less about 
the issues of ethical review than I thought I knew (Awareness). 

• Because I am relatively new to formal research I have had to limit my 
passion with regard to most of the statements. This is because I do not 
have enough experience to think through all of the possible 
ramifications of some of the statements. In other words, I am not 
familiar with how badly research may be abused (Lack of 
background). 

Comments containing elaboration and interpretation (or both) showed 
the kinds of difficulties the survey (and in some cases the instrument itself) 
presented. The more experienced group of invited researchers posted 
proportionately more of both of these types of comments, and were more 
detailed in their observations. 

• In some research studies, it may be necessary to withhold the details 
of the study from the subjects to prevent contaminating the study. In 
this case proper debriefing must be conducted after the study 
(Elaboration). 

• Some of my responses are extreme, both in favor of subjects' ethical 
treatment, and in favor of keeping certain information from them if it 
might impair the research. Too much information can be harmful to 
human subjects, even when the information is overtly in their 
interests, and not prejudicial. Other responses are more intermediate, 
when the question raises points that may generate opposing ethical 
views (Elaboration). 

• Some of the answers have to fall in the it depends category, because the 
capacity of the potential research participants and the power (actual 
or perceived) that the researcher has are so important in achieving 
ethical research. For example, if a video of behavior at red lights is 
being used for safety research, I don't think it is reasonable to try to 
get the informed consent of every blob on the video who stops for the 
red light or jaywalks. 

• One problem that is particularly important for distance educators is 
the issue of the on-line survey and multi-site research. I conducted 
research on adult distance students with 2 other researchers from 2 
other universities. We wanted to post the survey on a web-site, 
making it TOTALLY anonymous. We had to get permission from 
three different REBs. Each wanted to have different changes, so we 
took MONTHS to-ing and fro-ing to get an on line survey and 
information home page that all would agree to. 
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• When participants are not vulnerable, the risks are minimal and 
consent is informed, some REBs spend a great deal of time on trivia 
and grammar, not on protecting the vulnerable. My concern is the 
volume of work they create for themselves if they do not have an 
expedited review process. (For example. I've had trouble getting 
permission to contact graduates over whom no one has any control). 
They may miss ethically questionable projects in the volume of 
reading required (Interpretation; Anecdote). 

• When working with minimally literate populations, written consent is 
not possible. When working with other cultures, the whole notion of 
"informed consent" needs to be re-examined and probably re-shaped 
(Elaboration). 

As shown in some comments, some respondents found items difficult 
to rate (it depends) because of the possibility of more than one defensible 
response: "the question raises points that may generate opposing ethical 
views." Also, the problems outlined in free responses offer insights into 
important emerging areas of concern for researchers: providing more 
guidance to cross-cultural researchers and assuring that collaborative 
proposals are not penalized by the requirement for multiple institutional 
reviews. 


Summary of Findings 

The survey questionnaire used in this study was constructed so that items 
not consistent with the TCPS were more restrictive, imposing limitations 
not actually required by the TCPS. The general agreement with these items 
by the respondents, therefore, amounted to the imposition of more restric- 
tions on researchers than the Policy itself demands. Those agreeing with 
these nonauthentic principles were in effect "more royalist than the king," 
in comparison with the TCPS's actual requirements. 

The results also suggested that a restrictive view of ethics could not be 
attributed to study or reflection on the issues, as most participants ad- 
mitted little familiarity with the TCPS or with ethics (overall, 82% rated 
their familiarity with the Policy low or none, and 74% rated their ethics 
experience low or none). On the tree-response portion of the question- 
naire, one-third of the comments either acknowledged the respondent's 
lack of background or stated that the respondent's awareness of the issues 
had been sharpened by participation in the study. These results suggest 
that the Policy's goal of serving as an educational resource had apparently 
not yet been achieved for many respondents. 

Research experience was the criterion that most distinguished respon- 
dents: greater self-reported research experience was associated with 
several factors, including academic credentials (holders of graduate 
degrees were more likely to report high levels of research experience) and 
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experience with ethics, REBs, and the TCPS (higher levels of researcher 
experience accompanied higher self-reported levels of ethics and REB 
experience, and greater self-assessed familiarity with the Policy, whereas 
low research experience was accompanied by less or no experience in 
these areas). Respondents with high self-reported research experience (6 
or 7 on the 7-point scale) differed from the rest of the sample on seven 
specific survey items (of 31; 23%): they were more likely to agree, or to 
agree more, with items consistent with the TCPS and to agree less on, or to 
be neutral toward, items not consistent with the Policy. 

The invited researchers' views were in the same vein as those with high 
self-reported research experience, but more marked: on 12 of 31 items 
(39%), the invited researchers were more likely to agree, or to agree more 
strongly, with items consistent with the TCPS, whereas they more often 
disagreed or were neutral on items not consistent with the Policy. Overall, 
the ratings of the invited researchers on consistent items were higher 
(more in agreement), whereas they were lower on not-consistent items. In 
the free-response section, the invited researchers as a group were more 
likely to comment, and their comments more often referred to direct 
personal experience with specific issues of ethics or of the review process, 
whereas the less- or inexperienced more often merely commented on their 
lack of background on these issues. 

Discussion and Conclusions 

These findings relate to the composition of REBs and may explain some of 
the problems REBs have encountered in their work with researchers. The 
findings indicate that the group with the best understanding of the TCPS 
were the invited researchers, especially those with TCPS familiarity and 
REB experience. Similarly, by virtue of their backgrounds, these in- 
dividuals may be regarded as representatives of distance education's 
present and evolving "ethical norms and practices" (p. i.9). However, the 
TCPS legislates that REBs must comprise a minimum of five members: "at 
least two [with] broad expertise in the methods of the areas of research 
that are covered by the REB"; "one member . . . knowledgeable in ethics"; 
"one member . . . knowledgeable in the relevant law" (suggested, but not 
required, for nonbiomedical research); and "at least one member who has 
no affiliation with the institution, but is recruited from the community 
served by the institution" (p. 1.3). The objective is "to ensure the expertise, 
multidisciplinarity and independence essential to competent research 
ethics review by REBs" (p. i.3). By the above criteria, a five-member REB 
might be constituted with as many community members as experienced 
researchers. The REB will also have an ethics expert, intended "to alert the 
REB to potential ethics issues and options." Neither the community repre- 
sentatives nor the ethics expert are required to have any relevant research 
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experience or any specific knowledge of the ethical norms and practices of 
the disciplines served. Thus the Policy's intentions notwithstanding, REBs 
may not actually possess "both the training and the expertise to make 
sound judgments on the ethics of research proposals involving human 
subjects" (p. 1.3), when they review proposals from fields such as distance 
education. (Pertinent to the requirement for professional "ethics expertise" 
is Small's, 2001, warning: "One idea should, I think, be ruled out at the 
start: any notion that a training in philosophy brings with it some special 
authority where ethical judgments are concerned" [p. 387].) 

Further, although the TCPS states, "members of the REB ... should 
contain a majority of those whose main responsibilities are in research or 
teaching" (p. 1.3), the Policy does not address how this is to be assured, nor 
does it insist that the "research or teaching" backgrounds of REB members 
be relevant to the research under review. The TCPS specifically warns 
against "the imposing [of] one disciplinary perspective on others" (p. i.2), 
and we describe above examples of the chagrin of researchers in the face of 
"alien" standards (Owen et al., 2001). Our results suggest, however, that 
unless provision is made to secure and give prominence to the judgment 
of experienced disciplinary researchers, the review process could fail to 
represent the appropriate ethical norms and practices as directed by the 
Policy. 

Training is another issue for REBs, especially for members with less 
experience in research or ethics, as a way of avoiding unnecessary conflicts 
with researchers. The TCPS presently does not mandate training of any 
kind for REB members, apparently assuming that boards will be self-suffi- 
cient on appointment: "The majority of members of an REB should have 
both the training and the expertise to make sound judgments on the ethics 
of research proposals involving human subjects" (p. 1.3). Without the 
provision for training, however, the possibility of misjudgments due to 
lack of appropriate background cannot be discounted. Some of the anec- 
dotes shared by the respondents in this study and found in the literature 
reviewed suggest that ongoing REB training might help avoid some of the 
issues that have arisen. 

This study focused on the views of researchers and consumers of 
research in distance education. It did not address the views of REB mem- 
bers or of those responsible for the development of the TCPS and its 
contents (Interagency Advisory Panel, 2002). Research involving these 
bodies, a wider sampling of social science researchers, and those with 
cross-disciplinary backgrounds might produce more information on the 
congruence between the thinking of researchers, REB members, the 
framers of Canada's ethics policies, and the Policy itself. 

Also timely would be some review of the workings of REBs as they are 
now constituted, to identify and share with the social sciences and 
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humanities research communities any issues that have been identified to 
date. REBs have existed long enough to have a record capable of evalua- 
tion. In the spirit of openness and consultation, managers of the ethics 
review process at the national level should share with researchers 
whatever data they have gathered, or develop data if none exist, on the 
present system. Of special concern would be any evidence of inconsisten- 
cy among REBs. The TCPS aspires to be a national, cross-disciplinary 
guide; lack of consistency in the application of core principles, which our 
findings warn might occur if the process is placed in inexperienced or 
unknowledgeable hands, could suggest excessive subjectivity, even 
caprice, in a vital part of the research process, potentially placing an 
unnecessary constraint on competent researchers and ethical research. 
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31. If identifying information is not involved, 4.50 1.87 3.93 1.79 3.78 2.01 3.83 2.17 3.93 1.95 

REB approval need not be sought for 
secondary use of data (p. 3.5). 
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